Optimizing Red Blood Cells Consumption Using Markov Decision Process

Modeling Healthcare Data using Markov Decision Process

Outline Objective Background: Stochastic tools used in healthcare MDP in healthcare Preliminaries Optimality Equations and the Principle of Optimality Solving MDPs Examples References Objective: To discuss the construction and evaluation of Markov Decision Process (MDP) To investigate the role of MDP in healthcare. To identify the most appropriate solution techniques for finite and infinite-hor...

Dynamic Decision Model using Partially Observable Markov Decision Process

Quantile Markov Decision Process

In this paper, we consider the problem of optimizing the quantiles of the cumulative rewards of Markov Decision Processes (MDP), to which we refers as Quantile Markov Decision Processes (QMDP). Traditionally, the goal of a Markov Decision Process (MDP) is to maximize expected cumulative reward over a defined horizon (possibly to be infinite). In many applications, however, a decision maker may ...

Regulation of nitric oxide consumption by hypoxic red blood cells.

The homeostasis of nitric oxide (NO) is attained through a balance between its production and consumption. Shifts in NO bioavailability have been linked to a variety of diseases. Although the regulation of NO production has been well documented, its consumption is largely thought to be unregulated. Here, we have demonstrated that under hypoxic conditions, NO accelerates its own consumption by i...

A generalized Markov decision process

— In this paper we present a generalized Markov décision process that subsumes the traditional discounted, infinité horizon, finite state and action Markov décision process, VeinotCs discountéd décision processes, and Koehler's generalization of these two problem classes. Résumé. — Nous présentons dans cet article un processus de Markov généralisé qui englobe le processus de décision markovien ...

Using Markov Decision Process for Construction Site Management in Cameroon

Building construction sites are enclosed and restricted environments with minimal space to maneuver objects. Thus the organisational management of cost control, time and quality of construction projects is a huge challenge. Methods of project management commonly used by companies in developing countries are essentially planning schedules. Often, these methods are based on the assumption that co...